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Abstract 

The core idea of stochastic stability is that thermodynamic observables must be robust 
under small (random) perturbations of the quenched Gibbs measure. Combining this idea 
with the cavity field technique, which aims to measure the free energy increment under 
addition of a spin to the system, we sketch how to write a stochastic stability approach to 
diluted mean field spin glasses which explicitly gives overlap constraints as the outcome. 
We then show that, under minimal mathematical assumptions and for gauge invariant 
systems (namely those with even Ising interactions) , it is possible to "reverse" the idea of 
stochastic stability and use it to derive a broad class of constraints on the unperturbed 
quenched Gibbs measure. This paper extends a previous study where we showed how to 
derive (linear) polynomial identities from the "energy" contribution to the free energy, 
while here we focus on the consequences of "entropic" constraints. Interestingly, in diluted 
spin glasses, the entropic approach generates more identities than those found by the 
energy route or other techniques. The two sets of identities become identical on a fully 
connected topology, where they reduce to the ones derived by Aizenman and Contucci. 

1 Introduction 

Polynomial identities have a long history in spin glass theory, from the early development by 
Ghirlanda and Guerra (GG) [12] and by Aizenman and Contucci (AC) [TJ [^U] at the end of 
the 1990s. The link with the peculiar organization of states (in the low temperature phase) 
discovered by Parisi j22] was guessed immediately; however, it is only in the past few years 
- and only for fully connected mean field systems, namely the Sherrington-Kirkpatrick model 
(SK) [55j - that Panchenko has been able to show the deep connection between polynomial 
identities and ultrametricity [211 US [5^ . 

Following the seminal approaches, the former based on checking the stability of states by 
adding all possible p-spin terms [17l[T3l[T4] and then sending their strength to zero, the latter 
using a property of robustness of the quenched Gibbs measure with respect to small stochastic 
perturbation [J [HI IS] > identities for the SK model have by now been obtained with a number 
of different techniques, e.g. via smooth cavity field expansion [1], linear response stability 11 , 
random overlap structures [29] or even as Noether invariants |18| . In the diluted counterpart of 
the SK model, which is the Viana-Bray model (VB) [32] , a similar research effort has produced 
classes of identities that naturally generalize the ones obtained earlier by AC (see for instance 
[i US]) and GG (see for instance [IS1I23])- 

It has since been possible to show to validity of these polynomial identities even in short- 
range, finite-dimensional models [T] [TOl [131 [30] , and novel techniques to obtain other identities, 
with the aim of finding a set of constraints on the overlap probability distribution strong enough 
to enforce the replica symmetry breaking scheme, are still of great interest, especially beyond 
the SK framework (see e.g. P^[?7]). 
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In this paper, to complement the analysis begun in |29) (where we showed how to obtain 
polynomial identities in spin glasses by considering the energy contribution of random overlap 
structures developed in [5]), we show how to derive AC- like polynomial constraints for the 
Viana-Bray model even from the entropic contribution. Namely, we add a (random) pertur- 
bation term in the Boltzmann factor - close in spirit to the cavity field approach - and then 
show that, in the thermodynamic limit, this is irrelevant on average as it coincides with a 
negligible shift in the connectivity. However, the introduction of this "innocent" perturbation, 
within the standard stochastic stability framework, enables us to derive linear combinations 
of the constraints on the perturbed Boltzmann measure. The latter converges to the unper- 
turbed measure and returns the identities (all together, combined into an infinite series) as a 
consequence. 

To obtain the constraints as separate identities, we go further and "reverse" the idea of 
stochastic stability. We introduce the random perturbation only as an overlap generator via 
derivatives; once we then get the desired polynomials, we evaluate all their averages within the 
original unperturbed quenched Gibbs measure. Remarkably this procedure, subject to minimal 
mathematical assumptions, produces separately all the AC-like identities (which reduce to the 
standard AC constraints in the SK model limit of high connectivity) , generalizing all known 
results. Our arguments do not amount to a rigorous proof, but we hope that they may serve 
as inspiration for future work in this direction. 

2 Model, notations, cavity perspective and preliminaries 

In this section we provide a streamlined summary of previous results to make the paper self- 
contained. In particular, after introducing the model (and the associated standard statistical 
mechanics definitions), we explain in two further subsections the cavity field and stochastic 
stability perspectives as applied to diluted spin glasses, with the aim of showing the deep 
link between these two approaches. In the last subsection we discuss a decomposition of the 
free energy that highlights the synergy among the cavity field and stochastic stability points 
of view, and provides a suitable starting point for our investigation of polynomial overlap 
constraints. 

2.1 The diluted spin glass 

To introduce the model (originally studied by Viana and Bray in [32]), let us consider N Ising 
spins CTi € {+1, with i running from 1 to A'^; ct = (tri, . . . , a^) will denote the complete 
spin configuration. Let be a Poisson random variable of mean C, and let the {Ju} be 
independent and identically distributed copies of a random coupling strength variable J with 
symmetric distribution. For the sake of simplicity, and without undue loss of generality |21j . 
we will assume J — ±1. The coupling strengths Ji, will determine binary interactions between 
spins at sites the latter are independent identically distributed random variables, 

with uniform distribution over 1, . . . , A'^. If there is no external field, the Hamiltonian of the 
Viana-Bray (VB) model for dilute mean field spin glass is then 



The non-negative parameter a is called degree of connectivity: if the sites i are regarded as 
vertices of a graph, and the pairs [iv^jv) define the edges of this graph, then each vertex is 
the endpoint of on average 2a edges as explained below. 

The Hamiltonian ([T|) as written has the advantage that it is the sum of (a random number 
of) i.i.d. terms. To see the connection to the original VB-Hamiltonian, note that the Poisson- 
distributed total number of bonds obeys PaN = ctN + 0{\/N) for large A^. As there are A^^ 
ordered spin pairs (z, j), each gets a bond with probability ~ a/N for large N. The probabilities 
of getting two, three (and so on) bonds scale as 1/N'^,1/N^, . . . so can be neglected. The 




(1) 



probability of having a bond between any unordered pair of spins is twice as large, i.e. 2a/N. 
For large N each site therefore has on average 2a bonds connecting to it, and more precisely 
this number of bonds to each site has a Poisson distribution with mean 2a. The self-loops 
that we have allowed just add cr-independent constant to the Hamiltonian so are irrelevant. 

We will denote by E the expectation with respect to all the (quenched) variables, i.e. all 
the random variables except the spins, collectively denoted by J. The Gibbs measure oj is 
defined by 



ijv(a,/3) 



for any observable (f : { — 1,+!}^ M, where ZN{a,l3) — exp(— /SiJ^vlc, a; J^)) is the 
partition function for a finite number of spins N. When dealing with more than one configu- 
ration, the product Gibbs measure will be denoted by f2, and spin configurations taken from 
each space in such a product are called "replicas". We use the symbol (.) to mean (.) — En{.). 

We will often omit the dependence on the size of the system N of various quantities, a 
convention already deployed above. In general, we will allow slight abuses of notation to 
lighten the expressions as long as there is no risk of confusion. The pressure P/v(a, /3) and the 
free energy density /jv(a,/3) for given system size N are defined by 

PN{a,l3) = -PfN{a,l3) = In Z^(a, /3), 

and we assume that the limit limTv^oo PN{oi,P) = P{ol, (3) exists. 

The entire physical behavior of the model is encoded by the distribution of the (even) 
multi-overlaps (?i...2n, which arc functions of several configurations defined 

by 

N 



1 (1) (2«) 

i=l 



By studying the behavior of these order parameters it is possible to obtain a phase diagram for 
diluted spin glasses in the (a, /3) plane which consists of an ergodic phase (where all overlaps 
vanish in the thermodynamic limit of large N) and a spin glass phase (where the overlaps are 
positive), separated by a second order critical line given by 

2atanh(^) = l. (2) 

2.2 The cavity perspective 

Following the idea at the heart of the cavity approach (namely, measuring the effect on the 
free energy of the addition of one spin to the system; see [51 129) for a summary), we write, in 
distribution, 

^r, P„ 2JV P a 

TTTT jV+1 A/-f 1 

HN+iicr,aN+i,a;J) = — ^ JvC^i^f^j,, ^ J'^'^i'^'^N+i — ^ J',!'^n+i ^ (3) 

u—l u—1 u—l 

where aN+i is the added spin. The { J^, J"} are independent copies of J, and {ii/}, {ji/}, 
are independent random variables all uniformly distributed over {1, . . . , N}. The last term in 
([3]) does not contribute when N is large, and at any rate is a constant which cancels from the 
Boltzmann measure. 

Note that we can equivalently write the above decomposition as 

HN+ii<J,o-N+i,a]J) = HN{cr,a';J) + hN+i<TN+i (4) 



where 



N 



Exploiting the additivity property of Poisson variables, we can also decompose the Hamiltonian 
for an A^-spin system so that it shares the first term with TJat+i: 

HN{a,a-J) ^ HN{a,a'-J) + HN{a,a' IN-J) , (5) 

where the two Hamiltonians on the right hand side have independent quenched random vari- 
ables J and J . Hence, if we call 

HN{a; a'/N; J) = HN{a, a'; J) = -J2 J-n^^'h ' 

i/=i 

then 

ZM+i{a,P) ^^^^ exp(-/3/ijv+iajv+i) 
E.e.exp(-/?i7(a,a';i)) ' 

with 

As elegantly explained in [3], and discussed in detail in this equation expresses the in- 
cremental contribution to the free energy in terms of the mean free energy of a spin added 
to a reservoir whose internal state is described by (c, ^o-); corrected by an inverse- fugacity 
term H, which encodes a connectivity shift. The former may be thought of as the cavity into 
which the (TV -I- 1) particle is added: for N :s> I, the value of the added spin, aN+i, does not 
significantly affect the field that would act for the next increment in N. Hence, for the next 
addition of a particle we may continue to regard the state of the reservoir as given by just the 
configuration a. However, the weight of the configuration (which is still to be normalized to 
yield the probability of the configuration) changes according to 

y ^^g~;3/ijv + iO'jv + i 

This transformation is called cavity technique. 



2.3 The link to stochastic stabihty 

The addition of a new spin can, because of the randomness of the couplings, effectively be 
regarded as an external random field that vanishes in the thermodynamic limit. This is 
essentially the perspective of the stochastic stability approach [51 [3] . 

By an interpolation method [1] the {N + l)-th spin can be added to the A^-spin system 
smoothly via an appropriately defined cavity function ^'(q!,/?,^), t e [0, 1], which reads 

*(a,^,i) = Elnw(e'^^-=°' "''''"'I^. (6) 

Due to the gauge symmetry of the VB model, namely the symmetry — > cr,;„(Tjv+i (whose 
action leaves the VB Hamiltonian invariant), the above cavity function turns out to contain an 
effective two body interaction, as in the original Hamiltonian, and the sum over ctat+i = ±1 
in the partition function gives a trivial factor two because ctjv+i plays the role of a hidden 
variable; this factor two yields, once the logarithm is taken, just the high temperature entropy. 

Inspired by the cavity perspective, taking 1^9 as a generic function of the spin configuration, 
we can define a generalized Boltzmann measure (denoted by the subscript (.)*) as 

uj{(p{a)e^ ^--^ - v) 
a;(e ^"=1 " v j 

Note that in the t = Q case we always recover the unperturbed Boltzmann measure of an A''-spin 
system and in the t = 1 case we recover the unperturbed Boltzmann measure of an TV -I- 1-spin 
system, with a small shift in the connectivity that becomes negligible in the thermodynamic 
limit. 



Let us now briefly describe the stochastic stability properties for averaged overlap correla- 
tion functions (OCFs); these will become useful shortly. We split OCFs into two categories: 
filled OCFs, showing robustness with respect to the stochastic perturbation, and fillable OCFs, 
showing saturability with respect to the same perturbation. 

• Filled OCFs are monomials in overlaps among s replicas such that each replica appears 
an even number of times. Examples are 9^21 91234 O'" 9i29239i3- 

• Fillable OCFs are overlap monomials among s replicas which become filled when multi- 
plied by a single overlap among exactly those replicas appearing only an odd number of 
times. Examples are 912, (71234 or (712913. 

It should be pointed out that all monomial OCFs are either filled or fillable, because one 
can always find a multioverlap to fill any (monomial) OCF that is not filled. This contrasts 
with the case of the SK model, where only overlaps among two replicas can be used to fill 
an OCF [4]. The division into filled and fillable OCFs is made because of differences in how 
their averages react to the perturbing field induced by the cavity function [H |6l [29] . In the 
thermodynamic limit, the averages of the filled OCFs become independent of t, i.e. 

lim a* (filled OCF)( = 0. 

We refer to this property as robustness. 

On the other hand, using the gauge symmetry, one has in the thermodynamic limit that 
the averages of fillable OCFs become filled a.t t — 1, namely [H [HI [H] 

lim (fillable OCF)f=i = lim (filled OCF)t=i = lim (filled OCF). 

JV^oo N^oo N^oo 

We refer to this last property as saturability. Note that we have dropped the subscript t 
in the last equality because of the robustness of filled OCFs. Examples of saturability are 
(gi2)t=i = (qh)^ (gi234)t=i = (qhsi) and ((712(713)4=1 = (912913923), with the limit N co 
always understood. 

We only sketch the proof of the above propositions and refer the reader to [U [51 [HI [IH] 
for a detailed discussion and proofs. Let us show how the fillable OCFs turn out to become 
filled OCFs in the iV ^ 00 limit at t = 1. The stability of the filled OCFs will then be 
a straightforward consequence of their gauge invariance, which is heavily used in the proof. 
Consider the simplest case of a monomial Qab that is fillable by multiplying by Qab, with 
replicas a and b each appearing only once in Qab- Then we can write 

{Qab)t = {Y,{ayyN')Q,,{a))t 

where Qij contains all factors that do not depend on replicas a or b. Factorizing the state fit 
we obtain 

{Qab)t = ^E(^Wt((7nWt((T^)f^t(Q.,)). 

Now rewrite the last expression for t — 1: by applying the gauge transformation cr^ — > aiaN+i, 
the states acting on the replicas a and b are ujt=i{crf) — )■ u}{a'^a%^i) + 0{N~^) while the 
remaining product state fit continues to act on a even number of occurrences of each replica 
and is not modified (in a manner directly analogous to the robustness of averages of filled 
OCFs). Putting all the replicas back into a single product state, we have: 

a.«(7j^+i)a;(a^^+i)r!(g.,) = n{<j1ay^+,a%+M. (7) 

Now the index N + I can be replaced by a dummy index k that is averaged according to 1 = 
X^fcLi! this does not change the result except for 0{N~^) corrections - from values of k 
that coincide with i, j, or further summation indices in Qij - that vanish in the thermodynamic 
limit. Since J2k=i ^k^k — lab, this gives the desired result. □ 



2.4 The free energy decomposition 



In this subsection we want to show that the free energy density can be written in terms of an 
"energy-hke" contribution and an "entropy-hke" one. As a consequence of this decomposition, 
and given that we have previously investigated the constraints deriving from the energy-like 
term we will then restrict our investigation to the entropy-like contribution, which (as we are 
going to show) is encoded in the cavity function. 

It is in fact always possible, via the fundamental theorem of calculus, to relate the free 
energy to its derivative with respect to a chosen parameter, here the connectivity a. Clearly 
the result is a relation between the free energy and its a-derivative where, interestingly, the 
missing term is exactly the cavity function. In the thermodynamic limit this decomposition 
takes the form 

P{a, 13) + adaP{a, 13) = ln2 -f ^'(a, /3, i = 1). (8) 

We emphasize that the equation above, which we are going to prove using continuity and the 
fundamental theorem of calculus, can be thought of as a generalized thermodynamic definition 
of the free energy. In this approach, the cavity function naturally acts as the thermodynamic 
entropy, which is why its investigation suggested the title of the paper. 

To see briefly how (|5]) arises, let us write down the partition function of a system of 
-I- 1 spins at connectivity a* — a{N + l)/N, using the decomposition ([3]) of the relevant 
Hamiltonian: 

CT, (TiV + l— ±1 

o"jv + i=±l 

(7 

where in going from the first to the second line we have gauge transformed (T; — )■ aiaN-^-l. 
Multiplying and dividing by Zis!{a,j3) and taking logs we get: 

Pc/N 

\nZN+i{a*,l3) ==ln2 + /3 ^ J^' + In ZAr(a, ^) + In ^(e'^ ^"=° '^""■^ ). 

Averaging over the disorder removes the second term and transforms the last one into the 
cavity function at < = 1. Rearranging slightly, the result reads 

[ElnZAr+i(a*,/3)-ElnZAr+i(a,^)] + [ElnZAr+i(a,/3)-ElnZAr(a,/3)] = ln2 + *Ar(a,^,i = 1). 

Now a* — a = a/N becomes small as N grows so we can Taylor expand the first difference 
on the l.h.s. as (a/A)9QEln Z7v+i(a, /?) + 0(1/A^). The second difference on the l.h.s., on the 
other hand, gives the pressure as A^ — )■ oo, and so the decomposition ([8]) follows in the limit. 

3 Identities from "direct" stochastic stability 

Now that the theoretical framework has been outlined, we can turn to the polynomial identities 
themselves. First, in this section, we review the application of a standard approach from fully 
connected models to the diluted case [4 . To get constraints on averages of overlap polynomials 
from this method, one needs to heuristically separate term in a power series. In the next 
section, after deriving the general form of the required cavity streaming equation, we present 
a modification of this approach that automatically provides such a separation. We stress that, 
in the original SK contest, constraints are usually derived in /3-average [HIHIIH], namely one 
can prove that they are zero in the thermodynamic limit whenever one takes an average over 



a (however small) /3 interval but not point by point. Here the same results are obtained for 
the diluted counterpart by tuning a instead of /3, hence constraints are obtained in a-average. 

The standard approach referred to above studies the family of linear polynomial constraints 
(identities) on the distribution of the overlaps which can be obtained by perturbing the original 
Gibbs measure defined by the Hamiltonian ([1} with a random term suggested by the cavity 
technique, where we use as a probe for stochastic stability a generalization of the random 
perturbation given by the connectivity shift from Eq. (jS]). 

Specifically, we consider the quenched expectation of a generic function of s replicas, with 
respect to a perturbed measure defined by the following Boltzmann factor 

B(a,^,a',/3',0 =exp |^-/?FAr(t7; a; J) + /?' ' (9) 

whose use will be indicated with a subscript a',l3',t in the expectations ila',/?',* and {■)a',p',t- 
In this way the stochastic perturbation coincides with the one from the cavity technique if we 
choose t = 1 and a' = a, /?' = /3, while for t = Q we recover the unperturbed Gibbs measure. 

Loosely speaking, after a gauge transformation one can interpret Eq. © as the Boltzmann 
factor of a system of iV + 1 spins, as in the decomposition (U)). The generalization consists in 
letting the additional spin um+i experience a different inverse temperature, j3' rather than /?, 
and similarly allow for its connectivity to the other N spins to be set by a parameter a' ^ a. 
The new variables /3'and a' have been introduced for mathematical convenience; in the end, 
we will then evaluate everything at f3' — /3 and a' = a. 

In the following equations we will require powers of tanh(/3' J). Abbreviating 9 — tanh(/3') 
and exploiting that J = ±1, one has tanh2"(/3' J) = 6*2" and tanh^"+^(/3' J) = je^"+^ V n e N. 

To see how one can attempt to obtain constraints from the above generalized stochastic 
perturbation, consider a generic function Fs of s replicas. Its change with t is given by a 
"streaming equation" of the following form: 



a<b 



a<b<c 



■sis + l)is + 2) 3 

^a'.,p'A^) ^ — I 



(10) 



Here the replica indices a, 6, c all run from 1 to s. The above result can be checked by direct 
calculation and is shown for instance in [6]. We will derive a more general form below. 

If one chooses for F^ a function whose average does not depend on t (for instance a filled 
OCF, which is robust), the left hand side of ([TU]) is zero. In other words, one uses as the 
generator of constraints on the distribution of the overlaps the robustness property 

lim dt{Fs)a,0,t = 

where Fg is filled and a' = a, P' = (3. 

For Fg as above, one has on the r.h.s. of (ITOl) averages of fillable OCFs. The streaming 
equation is a power series in 9 (and hence in /?'). Heuristically, driven by the critical behavior 
of the OCF (as the general multi-overlap scales as {2a9 — 1)^" [5]), one can argue that 
all coefficients of this power series should vanish if the l.h.s. of ([TU]) vanishes. However, one 
has to bear in mind that, before setting a' — a and /?' — /3, the averages on the r.h.s. will 
still be dependent on /?'. The r.h.s. is not, therefore, a standard power series with constant 
coefficients. 

The simplest example of this reasoning is provided by Fg = with s — 2. The streaming 
equation is 

lim dt{ql2)c,',f}',t = lim {ql^ - 4^22^23 + iql2qzA) c.' ,[3' .tO"^ + 0{9^) = 

N^oo N^oo 



If one now assumes that the coefRcients of the powers of 9 are separately zero, then by setting 
t = 1, a' = a and /3' = (3 one can transform the fiUable average into a filled one to obtain 



lim {qf^ - 4gi2'?23 + 3g?2934) = 

N^oo 

This is the well-known Aizenman-Contucci relation. 

Choosing instead instead Fs — (71234 {s — 4,), and limiting the expansion to the first two 
orders 9 of the streaming equation, one obtains (again for N — >■ 00) 

9t{qi234)a',l3',t — ^^(3gi2349l2 ^ 8gi2349l5 + 5gi234956)Q',/3',t 
+ ^"(91234 - 16g?2349l235 + 60gi2349l256 " 809123491567 + 35gi23495678)a',/J',t + 0(6I^) = 

We re-emphasize that one cannot deduce that each term in this expansion vanishes separately, 
as the Boltzmann factor inside the averages is a function of /3' and hence 9, and therefore so 
are the averages. If one nevertheless proceeds and sets the coefhcient of the second power of 
9 to zero, one obtains at a' — a, f3' — /3 and t = 1 a relation between filled OCFs: 

3 5 

(9l2349l5> = g(9l234'7l2) + g(9l234956) > 

and similarly from the fourth order in 9 
(91234) = (169i2349i235 - 60g 

12349l256 + 80gi2349i567 35(7i234(75 g78) • 

These relations are in perfect agreement with previous investigations [16j and generalize the 
standard identities to diluted systems. Clearly when the connectivity diverges the multi- 
overlaps go to zero and the equations then no longer provide any non-trivial information. 

We note briefly here that a similar heuristic step, where coefficients of a power series are 
taken to be zero even though they initially depend on the variable that one is expanding in, is 
used implicitly in the derivation of the AC-like identities in [16j . The same comment applies 
to the arguments leading to the GG-like relations in [T5] . 



4 "Reversing" stochastic stability 
4.1 General streaming equation 

To go beyond the heuristic arguments reviewed in the previous section, we need to write down 
first the general form of the streaming equation pH]) . The i-dependence in the Boltzmann 
factor ([9]) arises only from the Poisson variable P2a't- For a generic function of such a variable, 
leaving off the factor 2a' initially, one has E/(Pt) — e~* J2T=o /(^)*'^/^' ^.nd so 

00 00 
dtEfiPt) = -e'* J2 /(fc)^Vfc! + ^ f{k)t''~'/{k - 1)! = -Ef{Pt) + E/(l + Pt) 

fe=0 fc=l 

Applying this to {Fs)a',i3'd gives 

where J is the random interaction strength for the additional coupling and i, drawn uniformly 
from {!,..., iV}, is the associated spin index. The resulting exponential can be written as 
]^^^j^[cosh(/3') -I- sinh(/3') Jcrf ] and cancelling the common factor [cosh(/?')]'' yields 

dt{F,)o.',p'.t , ,^ »o',/3',t(f.n:=i[i + j^<]) 



where 9 = tanh(^') as before. The denominator factorizes across rephcas, giving a factor 
[1 + J9^a' ,fi' ,t{o'i)\~'' ■ One expands this and also the numerator in powers of to get for the 
r.h.s. of the last equation 

y fc=0 l<ai<...<ak<s j ;=0 

To cast each term as an average over a replicated measure again, one can write ,fi' ,t{pi)^ = 
^a',p',t{<7i'^^ ■ ■ ■ fi^')- This gives as the general streaming equation 



2a' ^\ ' 



is + 1-1)1, 

k=0 l<ai<...<ak<s 1=0 



_ s+l ^s+l 

n{s-i)i 



where for brevity we have dropped the subscript a', /?', t on all averages. Now we gather terms 
according to equal powers m ~ k + 1 oi 9, and note that the m — Q term cancels with the —1: 



OAF, 



^—_IF,^{J9) ^ ...a, (-l)a, ...a, 

\ m = \ 1=0 l<ai<...<a,„_,<s ^ ' 

Here and below it is understood that the sum over ai, . . . , a„i-; vanishes when m — I > s, 
because it is then not possible to satisfy the constraint 1 < ai < . . . < am-i < s. 

Performing now the expectation over J cancels all odd orders to, and the expectation over 
i produces a multi-overlap, giving 



2c,' y ^ - ^ lUs- 1)1 ' ^' ^ '?ai...a„_,,s+l...s+;y . 

\ m=2,4,... ;=0 ^ ' l<ai<...<a„_i<s / 

To state this result in a compact form, we define 

— ;!(s-l)! ^ yai...a„_i,s+l...s+i- 

/=0 l<ai<...<a„_i<s 

The superscript to indicates how many replicas are involved in each of the overlaps in this 
expression. Each overlap is taken to the power n, a generalization which will be useful shortly. 
Then after re-instating the subscripts on the averages, the streaming equation can be written 
simply as 



2a' 



^IFs E 6'™Ci™'iM . (11) 

\ m=2.4,... I a'.,(i-,t 

We can now state the arguments of the previous sections in more general form. If Fs is 
filled then the derivative on the l.h.s. of (ITTT) must vanish. If one evaluates at a' — a, /3' — f3, 

t = 1 and for iV — >■ oo, all the overlaps in ci™'' become squared - the fillable averages become 
filled - so each factor ci™'^-* turns into a "higher order AC factor" ci"^''^K The identities from 
directed stochastic stability are therefore (for filled Fg and in the limit oo) 

/fs E ^'"'C'i^'^M = 0. 

\ 70=2,4,... / 



As explained above, one cannot necessarily separate the different orders in 9 in this result. 
This is possible by "reversing" the approach, as we will now see. 



4.2 Identities from reversed stochastic stability 



Progress in demonstrating that each term of the above expression must vanish separately, i.e. 

^i^sCi"*'^^^ — for each s and even m, can be made by considering not t ~ 1 but derivatives 

at t = and assuming that, in general, stochastic stability holds [H |9]. Let us take a generic 
overlap polynomial F^, and consider as above the "smooth cavity" perturbation with a modified 
temperature /3' and corresponding 9 = tanh(/3'). Then the first derivative w.r.t. t is (writing 
m = 2n now) 

a' .P' ,t \ ^ 



\ la'.R'.t 



2a' ^ \ " " la'S'-t 

n— 1 

Pulling the infinite sum out of the expectation and differentiating again (assuming that we 
can interchange differentiation with the infinite sum over n) we get 

q2 j TP \ oo oo 

<Jt s) a' ..13' ,t _ /)2(m+n) /p ^(2n, 1) /^(2™. 1) \ (^o\ 

n— 1 m—1 

From now on, take Fg to be filled and set t = Q instead of t = 1: we can then drop the 
subscripts on the average on the r.h.s. because at t = we have an unperturbed Boltzmann 
average. Then because of gauge invariance of this unperturbed state, all terms with m ^ n 
give vanishing averages: F^ is filled, ci^"'^'' consists of a sum of n-th order overlaps of n 
distinct replicas, and C'^^™^^'' of a sum of m-th order overlaps of m distinct replicas. At least 
|m — n| > 1 replicas therefore occur an odd number of times in all possible combinations of 
terms. Hence we can collapse the sum to 



{2a') 



OO 

t=0 n=l 



(13) 



One can simplify further: ci^"'^'' is as function only of replicas 1, . . . , s + 2n. This means that 
in the sum defining C^^'^'^'*, only the term with I — can give non- vanishing averages, 
because all other terms depend on some of the replicas s + 2n + 1, . . . , s + 4n and these would 
remain unpaired. In other words. 



1bi...b2^ j ■ 
l<bi<...<b2n<s+2n I 

But now for each term (?ai,...,a2„ in Cp"'^'' (with 1 < ai < . . . < a2n ^ s + 2n) there is exactly 
one entry in the sum over 1 < 6i < . . . < h2n < 3-\-2n which fills this term and gives a nonzero 
average, namely bi — ai, b2n — a2n- The multiplication by the sum over 6i,...,62n 
therefore just has the effect of squaring all the overlaps in ci^"'^' and we get 

{F,Cf-''^cf:il^)^{F,Cf-'^^ 

Inserting into (fT3| gives then 



{2a'Y 



2) 



Now we assume that we have stochastic stability for generic 9 [5J|5] and t, i.e. that {Fs)a',i3',t 
is independent of (3' and t in the limit iV — >■ oo. Then the last expression vanishes and hence 
so must all coefficients of different powers of 9. We thus obtain the relations (for s > 2 and 
n > 1) 

hm (F.Ci^"'^') = 0. (14) 

Af— s-oo 



This includes for rt = 1 all the standard SK AC-identities, but also all their higher-order 
generalizations. 

We now compare with closely related identities obtained by de Sanctis and Franz 15 , and 
Franz, Leone and Toninelli 16 . It is easy to check that the identities obtained in these papers 
can be written in our notation as 

hm (g?:.,C(2"-2p)^ ^ Q 

for arbitrary positive integers r and p. The identities (ITil) relate to p = 1 but are then rather 
more general because they allow arbitrary filled overlap polynomials for Fg. For example our 
identities for F3 = (?i2(723'7i3 are not contained in the set of identities from [TCI [T5] . 



4.3 Generalization to fields with multiple spins 



The generalization of the identities ([T4|) to exponents greater than two can be achieved rela- 
tively simply by a standard approach, allowing not just fields but p-spin interactions in the 
perturbing term. The perturbation term from ([9]) would then be generalized to 

(3' ^ J'l/CTii • • • fjP-i, 
1^=1 

and reduces to the latter for p = 2 as it should. 

In the streaming equation w.r.t. t, factors like af are then consistently replaced by cr^i 
and accordingly one obtains in the end 



dt{Fs)a',l3',t / p \ - Q7nr<( 



(15) 



m=2,4,... / ^ 



The calculation of the second derivative at t = generalizes in the same way, giving 



{2a') 



00 
Tl=l 



(^p^^i2nXp-l))y (16) 



Based again on the assumption of stochastic stability under a small perturbation of the Boltz- 
mann measure caused by the introduction of 0{N'^) random (p — l)-spin interaction terms 
into a system of N spins, one then deduces the identities 

lim (i^,Cp"'2(P-i») = 0. (17) 

N—>oo 

With the overlap exponent now generalized from 2 to 2(p — 1), these form a strict superset of 
the identities from [THl [IHI ■ 

We have been somewhat casual above in not distinguishing between odd and even order 
p — 1 of the perturbing Hamiltonian. Specifically, the reasoning that leads to the simplified 
form of the second derivative p6p works, by analogy with the case p — 2, only when p — 1 is 
odd. For even p — 1 a, more complicated expression analogous to (jl2p would result. However, 
in this case one can exploit the vanishing of the first derivative ([15]). Writing p—1 — 2{p' — 1) 
because p — 1 is even, one then obtains again the identities (|17p . with p replaced by p' which 
is now an arbitary integer. 

While we have assumed throughout Poissonian graphs, where each pair interaction is 
present independently of the others, one would expect that the identities (fT7)) hold also for spin 
glass model on other graphs with finite connectivity. The treatment in |16j is more general in 
this regard, and it may be possible to adapt the methods used there to generalize (|17p to this 
broader range of settings. 

Our reasoning leading to the general higher-order AC-identitites (fT7|) is, like the one in 
Ref. [ISIIIS], not rigorous. The main assumption here, as in the other papers, is stochastic 
stability for general values of (3' ^ f3. More technically, we have also been somewhat cavalier 
in our treatment of infinite sums, interchanging e.g. differentation w.r.t. t with summation. 



5 Conclusion 



The phenomenon of fuU replica symmetry breaking, and its probably best known conse- 
quence, namely ultrametricity, have deep implications in physics. It is for this reason that 
the Sherrington-Kirkpatrick model, which is the fully connected limit of the Viana-Bray di- 
luted spin glass discussed here, is sometimes described as the harmonic oscillator of complex 
systems. 

Parisi ultrametricity is a strong constraint on overlap probability distributions, and entails 
peculiar constraints for averages of polynomials of these. These linear (in the averages) poly- 
nomial identities were the subject of this paper. They are of interest in themselves, but also 
with regards to the question of how far results from the fully connected mean field framework 
can be extended to other scenarios. 

Linear identities in diluted spin glasses have already been obtained with standard tech- 
niques, mainly intensivity of the internal energy [16\ In our own work we have shown how 
they can be embedded within the framework of random overlap structures, and have analyzed 
in particular what identities can be obtained from the "energy" contribution to the free energy 
in this context ^29, . In this paper we showed how to recover all known linear identities by 
focussing attention on the entropy instead of the internal energy and then we highlighted how 
our method allowed us to further enlarge the set of identities. 

We reviewed first the results of a classical stochastic stability analysis, which contains 
within it, via a gauge transformation, the physics of the cavity approach. Linear identities for 
multi-overlaps can be argued for within this method, but require a heuristic separation into 
the different orders in 9 = tanh(/3'), where /3' is the inverse temperature associated with the 
stochastic perturbation. 

The main contribution of this paper was then to go beyond this. We started from a 
general streaming equation describing the effect of a stochastic perturbation on the Gibbs 
measure. Instead of perturbing the Gibbs measure and then using the thermodynamic limit to 
make the effect of the perturbation vanish, we evaluated averages directly in the unperturbed 
Gibbs state, using second derivatives with respect to the perturbation parameter t. This 
gives stronger results, in that identities from different orders in 9 can be cleanly separated; 
it also yields a larger number of identities compared to those obtained previously using other 
techniques. 

Conceptually, it is interesting that this new approach does not directly exploit the cavity 
nature of the perturbation, i.e. the mapping to a system of A'^-l- 1 spins when t = 1 and /?' = /3. 
But it certainly does use the gauge invariance of the unperturbed Boltzmann state. 

As we have emphasized, our arguments are not rigorous, requiring as the key assumption 
stochastic stability under general perturbations as well as some more technical conditions. We 
would hope, however, that our reasoning might in the future form the basis for a rigorous 
proof of all linear polynomial identities in diluted spin glasses. 
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